- Research
- Open access
- Published:
Sarve: synthetic data and local differential privacy for private frequency estimation
Cybersecurity volume 5, Article number: 26 (2022)
Abstract
The collection of user attributes by service providers is a double-edged sword. They are instrumental in driving statistical analysis to train more accurate predictive models like recommenders. The analysis of the collected user data includes frequency estimation for categorical attributes. Nonetheless, the users deserve privacy guarantees against inadvertent identity disclosures. Therefore algorithms called frequency oracles were developed to randomize or perturb user attributes and estimate the frequencies of their values. We propose Sarve, a frequency oracle that used Randomized Aggregatable Privacy-Preserving Ordinal Response (RAPPOR) and Hadamard Response (HR) for randomization in combination with fake data. The design of a service-oriented architecture must consider two types of complexities, namely computational and communication. The functions of such systems aim to minimize the two complexities and therefore, the choice of privacy-enhancing methods must be a calculated decision. The variant of RAPPOR we had used was realized through bloom filters. A bloom filter is a memory-efficient data structure that offers time complexity of O(1). On the other hand, HR has been proven to give the best communication costs of the order of log(b) for b-bits communication. Therefore, Sarve is a step towards frequency oracles that exhibit how privacy provisions of existing methods can be combined with those of fake data to achieve statistical results comparable to the original data. Sarve also implemented an adaptive solution enhanced from the work of Arcolezi et al. The use of RAPPOR was found to provide better privacy-utility tradeoffs for specific privacy budgets in both high and general privacy regimes.
Introduction
The data collected from users is an essential resource for the improvement of services provided by hosted platforms. The user data is aggregated to compute statistical properties that support or reject a hypothesis, drive analytics, and train Artificial Intelligence (AI) models (Lee and Clifton 2011; Tanwar et al. 2020a, 2021). This collection of user information is a double-edged sword since its misuse by malicious parties can infringe on the individual privacy of the participants. Data breaches that spanned from the leak of Netflix users’ information to recent incidents like the sale of login credentials of Zoom users or attacks on popular social platforms like Twitter, LinkedIn, and Whisper (Wagenseil 2020; Huang and Ban 2020; Memon et al. 2020; Boulanger, 2018) have resulted in a loss of trust among the users. The call for stricter laws resulted in regulations like General Data Protection Regulation (GDPR), Data Governance Act, ePrivacy Regulation, Do Not Track legislation, and so on (Härting et al. 2017; Tanwar et al. 2020b; Kirsch 2011; Mahanti 2021; Grafenstein et al. 2021; Xue et al. 2021). These regulations have thereby promoted user privacy needs from being an additional feature to a mainstream requirement from products and services.
The development of data privacy requirements has fueled research methods that ensure the release of user data with privacy guarantees. A privacy guarantee aims to protect against the disclosure of an individual's identity, or any of their attribute that might result in the identity disclosure (Ahamad et al. 2020). An attribute set A = {A1, A2, …, AD} belonging to an individual may contain information of varying sensitivities. For instance, the pregnancy status of the individual in a medical record may be more sensitive than their family history of Diabetes. An aggregator who collects such data would be aware of the patients’ identities but not their sensitive information. Therefore, privacy provisions need to be designed such that the presence of a specific individual cannot be discovered from a privatized record.
Privacy provision methods could be syntactical and simply suppress or generalize the identifying attributes and release the modified information. Some examples include k-anonymization, l-diversity, and t-closeness (Tu et al. 2018; Mehta and Rao 2019; Kacha et al. 2021). The information with suppressed fields could still be prone to inference attacks (Gatha et al. 2020a). Consequently, a semantic strategy was formulated to release user data in the form of query results. Differential privacy (Dwork et al. 2010a, b) is one such popular technique that provides individuals with plausible deniability of their participation in a data record.
Differential privacy (DP) allows for the addition of calibrated noise to ensure that the presence or absence of an individual in a record does not affect the query results. The most generic form of DP involves the addition of noise to the collected record of user information and subsequent queries are run on the modified data (Dwork et al. 2010a, b). But another of its variant named local differential privacy (LDP) (Xiong et al. 2020; Yang et al. 2020) has been accepted more widely. In this scheme, noise can be added at the end of the individuals who comprise the record. Noise addition at the source can prove to be particularly beneficial if the data aggregator is vulnerable to breaches or is a less trustworthy third party (Wang et al. 2018a, b; Wang et al. 2021a, b).
The estimation of statistical distribution from samples of a population is a classical problem (Nguyên et al. 2016; Xu et al. 2020) and one of the major metrics to determine the utility of privatized data. The attributes that belong to user data could be of different types that include but are not limited to textual, numeric, or temporal. In the case of numerical attributes, the expected statistical estimation property is governed by their type. For discrete or categorical attributes, statistical distribution estimation is the evaluation of the frequency of underlying discrete distribution (Zheng et al. 2021). For continuous numerical attributes, mean estimation is the most popular statistical task. The scope of this paper and the proposed solution is concerned with the frequency estimation of categorical attributes of locally-privatized data.
LDP has found wide acceptance and incorporation into mainstream solutions such as the collection of telemetry data by Windows10, collection of usage patterns by Google’s Chrome browser, Harmony by Samsung, and incorporation in Apple’s iOS among many (Kenthapadi et al. 2019). Moreover, research has enriched it further with the addition of robust techniques like randomization, shuffling, sampling, and k-anonymization (Zhao et al. 2019).
In comparison with the innovative approach of Federated learning, LDP has been found to give lower misclassification rates for a large population. It also offers the additional benefit of flexible control over privacy budgets (Zheng et al. 2020). Nonetheless, data privatized by LDP is prone to inference attacks especially if the query mechanism is hosted in an interactive setting. An adversary intent on executing a disclosure will have the necessary computation power and skills. With repeated and carefully crafted queries, they can generate a subset of results that can point to an individual's presence in the record (Rahimian et al. 2020). This problem is more relevant in the case of heavy hitters (Zhu et al. 2020), where the data for certain individuals is present more frequently in the distribution. Another consideration when DP is employed is the balance of privacy achieved by noise addition and the utility of the perturbed data (Li et al. 2021).
Synthetic data, also known as fake data, is fast gaining prominence as means of achieving privacy guarantees. Datasets that have similar statistical properties of distributions and correlations can be published in place of real or privatized real data (Campbell 2019). The advantages include higher privacy guarantees due to its immunity to inference attacks by reverse-engineering or background knowledge possessed by the adversary. But the technology is still in a nascent stage. There is scope to develop more efficient solutions that are not computation heavy or divulge real data that was used for its generation (Hittmeir et al. 2019; Emam et al. 2021).
In this paper, the combination of LDP through randomization and fake data has been enhanced to provide more robust privacy guarantees. The frequency estimation of the data privatized through the proposed framework was compared against the distribution of the original data for high-privacy as well as general-privacy regimes.
Motivation and techniques overview
The major concern that drives frequency estimation of privatized data is the design of a mechanism M to achieve minimal variance with respect to the original data. Wang et al. (2018a) introduced the term Frequency Oracle (FO) to denote a pair of algorithms < τ, υ > where mechanism τ outputs the perturbed or randomized attributes and υ is the estimation method. The algorithm υ is used by the aggregator for statistical computation over privatized data. Research has categorized FO into four major types namely, direct perturbation such as the use of randomized response (Warner 1965; Kairouz et al. 2016a, b; Lin et al. 2018), hash-based methods like RAPPOR (Erlingsson et al. 2014), transformation-based methods such as Hadamard response (Acharya et al. 2018; Liu et al. 2020), and subset selection (Wang et al. 2016).
Existing research like Random Sampling plus Fake Data (RS + FD) solution by Arcolezi et al. (2021a, b) devised FOs that utilized methods like GRR and OUE. The variant of RAPPOR used in our experiment used bloom filters. Bloom filters are highly space-efficient data structures that offer time complexity of the order of O(1) (Erlingsson et al. 2014). HR, on the other hand, has been proven by Acharya et al. (2018) to have the lowest communication cost of the order of log(b) in a b-bits communication. RAPPOR and HR are therefore more suited than GRR to lower the computational and communication complexities of a smart system.
The framework proposed in this paper aimed to answer if the hash-based method RAPPOR and transformation-based method Hadamard Response could be used to construct efficient frequency oracles. A frequency oracle may function on a high or a generic privacy regime based on the privacy budget. Generic privacy regimes are commonly found in internet browsers and similar real-world applications. While the original RS + FD solution had only been tested on high-privacy regimes, we tested frequency oracles for general-privacy regimes as well. The incorporation of RAPPOR provided better privacy-utility tradeoffs for some instances of privacy regimes. In addition, HR was evaluated as a candidate mechanism τ and found to perform on par with GRR and OUE.
Purpose and contribution
The RS + FD framework proposed by Arcolezi et al. utilized a combination of shuffling and sampling to achieve private frequency estimation for datasets containing categorical attributes. They also demonstrated how LDP combined with the use of fake data helped achieve a balanced privacy-utility tradeoff. We have summarized the workings of the approach in “Literature survey” section. The work by Arcolezi et al. used GRR and two variants of OUE (Wang et al. 2017). Their solution showed better performance than the conventional methods of splitting and sampling. The RS + FD also proposed an adaptive solution that dynamically selected GRR or OUE depending on which method offered lower variance. The performance of their framework was compared with existing solutions for high privacy regimens only.
Numerous researches have identified randomization techniques and their advantages based on performance in different scenarios. Acharya et al. (2018) compared the performance of RR, RAPPOR, subset selection, and Hadamard response (HR). The evaluation metrics for their comparison were communication cost and decoding time required for estimating underlying probability distributions. HR is based on a local hashing mechanism that is symmetric across the N users. Among the candidates, it was found to offer the best communication cost of log b + 2 bits per user, where b measured the size of the bit vector of the entity to be transmitted. Recent work by Chen et al. had also built on HR to propose a Recursive Hadamard Response (RHR) that facilitates privacy guarantees for the case of distributed learning (Chen et al. 2020).
In another paper, Acharya et al. (2019) have discussed how the construction of the Hadamard matrix incurs large memory costs. RAPPOR is a unary encoding-based method and is used as a primary LDP protocol by Google's Chrome browser. Le and Zia (2021) also carried out a comparative analysis and discovered that RAPPOR gave the best performance for benchmark datasets in high privacy regimes. This led us to consider the two mechanisms Hadamard Response and RAPPOR as randomization candidates τ to enhance the RS + FD solution by Arcolezi et al. We borrowed the fast implementation of RAPPOR by Cormode et al. (2021) and modified the HR implementation from Acharya et al. and tested their applicability to developing FOs extended from RS + FD. The details of the use of HR and RAPPOR can be found in next sections respectively.
The contributions of this paper can be summarized as:
-
We introduce the use of RAPPOR in combination with fake data to facilitate frequency estimation of multidimensional datasets under high-privacy as well as generic privacy regimens.
-
We introduce the use of Hadamard Response in combination with fake data to facilitate frequency estimation of multidimensional datasets under high-privacy as well as generic privacy regimens.
-
We extended the RS + FD solution by Arcolezi et al. through the incorporation of RAPPOR to compare privacy-utility tradeoffs offered by the new candidates. The enhancement was tested for high-privacy as well as generic privacy regimens. Furthermore, the utility of privatized data was tested using real-world as well as synthetic datasets. The proposed framework that incorporated advantages of multiple techniques has been named Sarve, a Sanskrit word that means ‘all together’.
Paper organization
The problem addressed in this paper and our contributions have been discussed in “Motivation and techniques overview” and “Purpose and contribution” sections, respectively. With the introduction to the premise of this paper, Sect. 2 recaps the preliminary information required by the reader, and “Literature survey” section contains the literature survey of the concerned research. “Proposed methodology” section explains the proposed methodology with the architecture of Sarve in “Overview of sarve” section. “Application of RAPPOR in a frequency oracle”, “Application of Hadamard response in a frequency oracle”, “Enhancement of adaptive RS+FD” sections detail the privacy-enhancing mechanisms RAPPOR and HR used in Sarve. In “Experimental results” section, we provide the implementation details of the solution. The metrics used for the evaluation are mentioned in “Evaluation metrics” and “Experimental setup” sections explains the experimental setup. The results achieved by the proposed solution and discussion are in “Results and discussion”. We have concluded the findings and scope for future work in “Conclusion” section.
Preliminary
Notations
Through the course of this paper, the constant \(\upvarepsilon\) denotes a privacy budget. The significance of its values has been discussed in further sections. RS + FD is the name of the solution by Arcolezi et al. which formed the basis of our research. The data to be privatized was assumed to contain N observations each belonging to an individual. Each of these observations had categorical attributes that were allowed a set of allowed domain values A = {A1, A2, …, AD}. The data aggregator would aim to get the frequency of each value in set A.
Local differential privacy
Local differential privacy has emerged as a well-suited technique for systems that aggregate sensitive user information. Its popularity can also be attributed to the fact that it can be achieved through a wide selection of privatizing mechanisms. These mechanisms can be selected for specific requirements like computational costs, data dimensionality, desired privacy regimes, and communication overheads. An \(\upvarepsilon\)-LDP is satisfied by a privatization mechanism M if it satisfies the probability condition,
where t and t′ are sets of values that differ by one element only and φ is the output after M has been applied to t and t′. If t and t′ are two records of user information that differ by the presence of an individual, then M will be applied to each entry in t and t′. The possible output of M identified as φ will differ by a factor of e^\(\varepsilon\) for both the user records.
The privatization mechanisms include perturbation or randomization. Assuming M to be a randomization method, if the private information t is denoted as a set T with k possible values such that T = [k] = {0, 1, …, k − 1}, M will map t Є T to d Є φ with a probability P(d|t). The output value d is the privatized sample that is shared by an \(\upvarepsilon\)-LDP-protected system. The privatization probabilities can be again shown as a factor of e^\(\varepsilon\) like:
The constant \(\upvarepsilon\) is called a privacy budget. As specified by Eq. (2), smaller values of \(\upvarepsilon\) put stringent restrictions on the mechanism M and therefore dictate a highly privatized output set. Conversely, bigger values of \(\upvarepsilon\) result in low or general privacy regimes (Kairouz et al. 2016a; Ye et al. 2019).
LDP mechanisms are particularly advantageous since they are understandable by novice users. Additionally, no original information needs to be shared with the data aggregator which lowers the legal and technical costs of ensuring privacy at the aggregator's end (Le and Zia 2021). The methods employed by LDP systems are relatively simpler to execute and restrict the communication costs of transmitting multidimensional data (Wang et al. 2019a, b, c). Despite providing strict privacy guarantees and multiple advantages, LDP mechanisms are vulnerable to adversarial manipulation. As proven by existing research, LDP-protected systems with high privacy regimes hosted in non-interactive settings are also vulnerable to manipulation attacks (Cheu et al. 2019a, b). Thereby, opening avenues for its use in combination with other privacy-enhancing techniques such as synthetic data.
Privacy amplification methods
The privacy guarantees provided by LDP can be further amplified by the use of methods like iteration, sampling, and shuffling. The privacy enhancement by iteration is based on how learning algorithms work. They create intermediate solutions and iteratively improve upon them using data points. It was proved that withholding the intermediate results produced by learning processes such as stochastic gradient descent can amplify the privacy guarantees (Feldman et al. 2018; Sordello et al. 2021).
Privacy amplification through sampling utilizes the existing technique of data sampling where partial contents are selected from the complete set (Balle et al. 2018). It is a resource-saving method that has been widely researched and is available in different variants. Li et al. presented that data sampling can minimize the disclosure potential of user information while being true to the data properties (Li et al. 2012). Feldman et al. showed that randomly shuffling the data records that are to be input to differentially private local randomizers improved the privacy guarantees of the system (Feldman et al. 2020; Erlingsson et al. 2019; Cheu et al. 2019a, b).
Frequency estimation
Real-world data that needs privatization is generally multidimensional and thereby adds more concerns to otherwise simpler computations. For the scope of this research paper, we focused on the frequency estimation of categorical attributes of multidimensional datasets. Due to the higher number of attributes, concerns for privacy budget \(\upvarepsilon\) also gain prominence (Wang et al. 2019a, b, c; Xu et al. 2020). The randomization mechanism M used to apply LDP to each user in the multidimensional dataset works in two ways. The first strategy divides the privacy budget \(\upvarepsilon\) over all of the attributes and the user then shares all of the randomized attribute values with the aggregator. In the second approach, a single attribute is selected through random sampling, and \(\upvarepsilon\) is solely applied to this attribute. Existing research has shown that while sampling and randomizing an attribute achieves a better privacy-utility trade-off, it might not be fair in case the sampled attribute is less sensitive than the others (Arcolezi et al. 2021b, a). Therefore, we explored the potential of improving the performance of LDP facilitated by the random sampling method.
The data released after privatization is used for statistical computation, and frequency estimation is one of the most common statistical goals for privatized categorical data. Assuming that the record consists of N users, where each user entry has only one value among the set of allowed domain values A = {A1, A2, …, AD}. The data aggregator would aim to get the frequency of each value in set A, denoted by.
where count(Ai) is the number of users who had reported attribute value of Ai, and is computed over the output of privatization mechanism M.
The computation of statistical properties of the aggregated data holds potential for privacy leaks. In the context of this paper, we focused on privacy leaks due to frequency estimation. The aggregator who collects the privatized data belonging to individuals would estimate the count of persons for each of the values in domain A. This collecting and the aggregating party is aware of the individuals who comprise the dataset but not the values of their private data (Arcolezi et al. 2021b, a). For instance, a diagnostic clinic application may collect protected health information during registration that could include pregnancy or HIV status. Since pregnancy status is limited to a very small demography of females between the ages of 13–45, the reported frequency for this field will be noticeable compared to other attributes. The computed frequency for this field when combined with other attributes like age or choice of further tests can help an adversary uncover the individual’s identity.
The potential for privacy leaks can be further elucidated when we consider the use of frequency estimation to identify heavy hitters. An attribute is labeled as a top-f heavy hitter if its estimated frequency is among the top f frequencies among all of the calculated values (Wang et al. 2021b). The password preference of people is one such use case. Persons belonging to younger generations may prefer to use the name of their favorite band or sports team as a password. Or, it is common knowledge that people end up using simple passwords like ‘Password123’, ‘Password@123’, or ‘P@ssword123’. An adversary could shortlist the easiest password to crack from the aggregated passwords of a user group (Naor et al. 2019). This is a particularly worrisome situation since many IoT devices are shipped with default passwords that are not changed by the users. Such leaks of passwords hold the potential to cause widespread botnet attacks like the Mirai (Naor et al. 2019). Therefore, there is a pressing need to research privacy-aware privatization and aggregation methods and this paper is a step to address it.
Literature survey
Differential privacy (DP) emerged as a frontrunner for semantic privacy definitions after syntactic privacy protection methods were found vulnerable to disclosures (Gatha et al. 2020b). Initial implementations of DP were based on a central model where the aggregator would add noise to the collected data and share it for further analysis (Dong et al. 2019). This required trust to be placed on a third-party and statistical computations could also cause identity disclosures (Kifer et al. 2020). With the adoption of DP into cloud-hosted services, the onus of privatization shifted to the users. This variant of DP called Local Differential Privacy provided individuals with more control over their privacy budgets (Wang et al. 2021a).
Over time, LDP has been adopted by many widely used platforms and service providers, thereby fueling research on its evolution. The evolution was aimed at addressing requirements such as multi-dimensionality and resulting complexities, communication costs, or decoding mechanisms (Acharya et al. 2018). The nature of the attributes present in the dataset to be privatized also governs the statistical computations. For instance, categorical attributes are computed for frequency estimation. These can be subsequently used to predict heavy hitters and balancing of user privacy with aggregator accuracy (Lopuhaä-Zwakenberg et al. 2020). For continuous numeric attributes, the statistical computations involve mean estimation. This particular class of attributes is a separate research subject (Xue et al. 2021; Wang et al. 2019a, b, c).
Akin to any technology that has been deployed to real-world applications, LDP also has shortcomings and vulnerabilities. It has been a known target of poisoning and other attacks due to the collection of data from multiple sources (Cao et al. 2019). This may allow an adversary to inject their compromised data and corrupt the collected records (Cheu et al. 2019a, b). Moreover, if hosted on an interactive platform, LDP privatized results are accessible for indefinite permutations of queries (Dwork et al. 2010a, b; Joseph et al. 2018). The biggest motivation for the adversary is the use of real user data that was randomized or perturbed by an algorithm. Reverse-engineering or statistical inferences are highly probable threats. A potential workaround to this problem has been proposed through the use of synthetic or fake data (Abay et al. 2018).
The generation of fake data is fast gaining popularity due to many reasons such as the need for precise labels for deep learning models (Alkhalifah et al. 2021; Hoffmann et al. 2019) or fears of identity disclosure by data holders (Snoke et al. 2018). The need for synthetic datasets became more prominent during the SARS-Cov-2 pandemic since the novel infection translated to a shortage of datasets to train medical AI models (Emam et al. 2021; Bautista and Inventado 2021).
This research domain is in the nascent stage. The construction of synthetic datasets and their utility metrics have become an exciting research problem (Snoke et al. 2018). Further exploration of this avenue also compared the protection provided by fake data against conventional methods like k-anonymization (Hittmeir et al. 2020). Recent findings showed that synthetic datasets having similar statistical properties as real data may offer privacy protection against inference attacks. The protection was on par with conventional anonymization methods (Stadler et al. 2022). Therefore, the generation of differentially-private synthetic data has been proposed as one of the solutions (Vietri et al. 2020; Quick 2021). While some methods have aimed at mitigation of bias in datasets (Ghalebikesabi et al. 2021), others have compared differentially-private synthetic data against baseline DP models for similar privacy budgets (Rosenblatt et al. 2020; Snoke and Slavković 2018).
Frequency estimation is a classic use case for privacy protection since analytics translate observations into the frequency of relevant attributes. Such statistical translation helps find relevant behavior such as the heavy hitters (Ben Basat et al. 2020; Pekar et al. 2021; Wang et al. 2021b; Zhao et al. 2022), frequent items (Luna et al. 2019; Wang et al. 2018a; Djenouri et al. 2018, 2019; Rouane et al. 2019; Li et al. 2019), or finding the marginals (Zhang et al. 2018; Cormode et al. 2018; Xue et al. 2021; Wang et al. 2019a, b, c). While individuals who comprise the records require plausible deniability from participation in the record, the statistical values should not deviate to extremes. Metrics and lower-bounds set for privacy-utility tradeoffs (Lopuhaä-Zwakenberg et al. 2019, 2020) are guiding lights for privacy provision methods. Numerous methods have therefore emerged that offer flexible privacy suited for different data release and trust regimes. Data can be released as marginal tables which may be in the form of count or range query answers (Wang et al. 2019a, b, c). Such privacy methods focus on the sensitivity and size of the dimensions and place zero trust in the aggregator. In contrast, some methods may assume the aggregator’s knowledge of the distribution followed by the attributes (Jia and Gong 2019). In a previous section, we have discussed the advantages offered by sampling to improve the offered privacy provisions. Privacy-preserved frequency estimation has also been achieved with a combination of sampling and Multi-Party Computation (MPC), a cryptographic protocol (Yang et al. 2021).
Proposed methodology
Overview of Sarve
Sarve is an enhancement of the RS + FD framework through the incorporation of RAPPOR as randomization techniques. As part of the analysis, the application of Hadamard Response to frequency oracles was also tested. The RS + FD framework was conceptualized for an LDP system that comprised of N users who send their privatized data to an aggregator. Each user dataset had been assumed to contain a set of D categorical attributes identified by the set A = {A1, A2, …, AD}. In the case of RS + FD, the randomization mechanism M could either be GRR, OUE-R, OUE-Z, or the adaptive solution ADP. In Sarve, the randomization mechanism M has been extended to include RAPPOR and Hadamard Response. Additionally, RAPPOR had been added as a candidate to ADP. We have summarized the methodology employed by RS + FD and thus Sarve in Fig. 1. In the next section, the incorporation of the new randomization candidates has been discussed in detail.
As described in “Purpose and contribution” section, the framework utilized a combination of sampling and fake data to privatize user records. Additionally, the tuples were shuffled before being input into sampling algorithms. This method has been proven to amplify privacy. If the data record contained N entries for each user, each described by D attributes, the workings of the adopted methodology can be seen in Fig. 1. A list comprising of possible values for attribute Ai was first shuffled among the N users, then split into two parts. The first part was privatized through mechanisms that included GRR, OUE, RAPPOR, and Hadamard Response, in addition to the adaptive methods. The second set of the attribute values for the remaining users was replaced by fake data that had been randomly selected from the allowed domain values [0, D − 1]. The privatized and replaced parts were merged to form the set of attribute values for statistical computation.
The RS + FD framework employed GRR and OUE techniques that are explained in the original paper. In the next section, we explain the incorporation of RAPPOR and HR and the resulting adaptive solution that has been named Sarve. The incorporation has been discussed in terms of the randomization and estimation algorithms of a frequency oracle.
Application of RAPPOR in a frequency oracle
The randomization in frequency oracle using RAPPOR
We used the basic form of RAPPOR that has been proven to satisfy ε-LDP. It is based on unary-encoding and is suitable for highly-dimensional datasets. As explained in Algorithm 1, the attribute values that were to be privatized were first one-hot encoded to convert the input set a Є [D] to R Є {0, 1}D, where D is the domain size of the attribute value and Rj = 1 for j = a and Rj = 0 for j ≠ a. The bit vector R is privatized by independently flipping each bit of R with a probability p given by Eq. (4). The probability q of flipping Rj where j ≠ a is given by Eq. (5).
Figure 2 illustrates the probabilities of sampling and flipping. Firstly, the part of attribute values to be privatized will be sampled with a probability beta = 1/D. The flipping of the bits will be done with probability p.
The fake data comprised of a zeroes vector that was again randomized using RAPPOR. To contain the noise that could be added through the fake data, zeroes vector were used instead of randomly selected set of values. The implementation of this method was done per Algorithm 1.
The estimation in frequency oracle
The frequency estimation method calculated the number of times the privatized data was reported. It is also a function of perturbation or randomization probability. For the randomizations carried out by probabilities p and q, Wang et al. (2017, 2018b) proposed the estimated frequency of privatized values as.
where D is the domain size of the reported attribute Ai, npriv is the number of times the privatized attribute was reported, and N is the total number of observations in the record.
Application of Hadamard response in a frequency oracle
The randomization in frequency oracle using Hadamard Response. The use of Hadamard Response for randomization is relatively recent among the other mechanisms mentioned in this paper. It is a hashing-based mechanism and therefore gives smaller decoding times as proven by Acharya et al. For randomization purposes, a Hadamard matrix is constructed in the form given by Eq. (7). For an attribute Ai that holds values within the allowed range [0, D − 1], the size of the Hadamard matrix is computed as D ≤ D′ ≤ 4*D. The Hadamard matrix HD` = {1, − 1}D′XD′ will be constructed as.
Additionally, it can be stated that H1 = [+ 1].
To privatize the attribute value Ai Є [0, D − 1], another value Ai`′ is selected from the domain size D′. This is done by choosing all of the elements from (Ai + 1)th row index and the same block as Ai of the Hadamard matrix. The set of values returned from the Hadamard matrix can be called SA.
To privatize Ai, an element from SA will therefore be randomly selected with a probability.
where h is the size of set SA. In the case of Sarve, we set D′ = D, h = 1, and SA = A, therefore.
Thereby the solution was rendered similar to a randomized response mechanism. Algorithm 2 summarizes the steps that were implemented to realize the mechanism. Figure 3 shows the probabilities and resulting attribute values for the application of HR.
The estimation in frequency oracle
The frequency estimation strategy was the same as for the case of GRR since we had reduced the use of HR to a randomized response method. The probability q of not selecting the new symbol from HA would be defined as.
The Eq. (6) would be modified to include the probabilities associated with the construction of set HA, and thus be used as
where npriv is the numbers of times attribute value Ai had been reported and N is the total number of individuals present in the record.
Enhancement of adaptive RS + FD
The user data in real-world conditions is multidimensional and uncertain. The variance is one of the most commonly used indicators to depict the utility of the privatized data. Therefore, an LDP protocol that results in lower variance can be dynamically selected among several candidates (Wang et al. 2017). Additionally, the mean square error (MSE) is a common evaluation metric for performance, and for estimators that are not biased variance can be measured as MSE (Wang et al. 2019b). In RS + FD, the authors dynamically selected between two candidates GRR and OUE to facilitate an adaptive LDP protocol. The results of experiments in this paper showed that the performance of Hadamard Response followed a trend similar to GRR but with bigger MSE values. Interestingly, RAPPOR performed better than GRR and OUE specifically for the general privacy regime. In Sarve, RAPPOR has been added as another candidate to further enhance the performance of the adaptive LDP protocol selection.
As seen in Fig. 4, the algorithm looks for the randomization method that offers the least MSE, or in this case variance. The variance for the GRR method is calculated as.
Since OUE and RAPPOR are both unary coding methods, the variance was formulated as.
The algorithm computed the variances, selected the randomization method that gave lowest variance, and carried out privatization using the chosen randomization scheme.
Experimental results
Evaluation metrics
The statistical computations of this paper were focused on frequency estimation of categorical attributes belonging to multidimensional datasets. The estimated frequency of the privatized attribute values was compared against the original frequency distributions. The metric for the comparison was the mean squared error (MSE) as shown in Eq. (14).
where f(ai) was the real frequency of the attribute Ai and was the estimated frequency of the attribute post-privatization.
Since randomization techniques had been employed for privatization, the algorithms were run 100 times, and mean MSE was computed for six different values of ε. Additionally, the algorithms were tested for regimes that mandated strong and general privacy. For the former case of strong privacy, values of ε were restricted to under 2, specifically a set of values were taken from RS + FD experiments as ε = [ln(2), ln(3), ln(4), ln(5), ln(6), ln(7)] = [0.6931, 1.0986, 1.3863, 1.6094, 1.7918, 1.9459]. The conditions for general privacy were defined by us with bigger values of ε = [2, 3, 4, 5, 6, 7].
Experimental setup
All of the executions for different experimental setups were carried out on the operating system Linux Mint version 20 (Ulyana). The scripts were written in Python version 3.8.10 language and run in the Jupyter Lab development environment. The enhancements implemented as part of Sarve were tested on similar conditions as Arcolezi et al.’s RS + FD. The experimental setups had used real-world as well as synthetic datasets with different values of ε, number of observations, and number of categorical attributes, and allowed values for each attribute of the relevant dataset. The three real-world test datasets were the UCI adult income (Kohavi 1996), UCI nursery admissions (Olave and Rajkovic 1989), and MS-FIMU (Arcolezi et al. 2021a). The different combinations of test setups used for benchmarking have been summarized in Tables 1 and 2.
The synthetic datasets were also constructed using Python scripts. As seen in Table 2, the generated distributions were uniform, except for non-uniform distributions labeled ES_Syn_5, ES_Syn_6, ES_Syn_11, and ES_Syn_12.
Results and discussion
The performance of RAPPOR, Hadamard Response, and RAPPOR in the RS + FD adaptive solution called Sarve were compared with three main methods of RS + FD. The three RS + FD methods used for benchmarking the proposed solutions include:
-
Spl[ADP] method had been implemented by randomly sampling a single attribute and spending the privacy budget ε on it. The adaptive approach selected between GRR and OUE for randomization was based on calculated variance.
-
Smp[ADP] method was implemented by splitting the privacy budget ε across all categorical attributes. The adaptive approach selected between GRR and OUE for randomization was based on calculated variance.
-
RS + FD[ADP] method that randomly sampled attributes and replaced some values with fake data. The adaptive approach privatized the true values of the attribute by choosing between GRR and OUE based on calculated variance.
The benchmarking aimed to show the performance of RAPPOR, HR, and Sarve such that the offered privacy guarantees and the utility of the privatized datasets were comparable to the above three methods. The results have been categorized based on testing through real-world and synthetic datasets.
Results on real-world datasets
The three multi-dimensional real-world datasets had a large number of observations with various types of domain values. As summarized in Table 1, the number of individuals varied from 12,000 to 88,000 with each dataset possessing six or more categorical attributes. The UCI Adult and MS-FIMU datasets had attributes that could take a value from a large set of values, i.e., set A was of the order of 10 or higher. The MSE averaged over a hundred runs for UCI Adult, UCI Nursery, and MS-FIMU datasets post-privatization by Spl[ADP], Smp[ADP], RS + FD[ADP], RAPPOR, Hadamard Response, and Sarve have been shown in Figs. 5, 6, and 7 respectively.
The effects of different factors like the number of observations attribute counts and domain values had affected the performance of randomization algorithms.
For high privacy regime
The UCI Adult dataset had 45 K observations and nine attributes. While Randomization through Hadamard response approximated the behavior displayed by GRR, privatization by RAPPOR was found to give lower MSE and thus a better utility. The use of RAPPOR in Arcolezi et al.’s RS + FD[ADP] did not degrade the performance of the algorithm.
The MS-FIMU dataset had the maximum number of observations at around 88 K and six attributes. The privatization offered by HR was not good but RAPPOR performed with a higher utility than the Smp[ADP] solution. Sarve created by the addition of RAPPOR to the RS + FD[ADP] enhanced the algorithm for the case when ε = 1.609.
The UCI Nursery dataset was the smallest among the real-world test data with the number of observations being 45 K and having nine attributes. While HR and RAPPOR alone performed better than Smp[ADP] but gave higher MSE than Spl[ADP]. The MSE values for Sarve and RS + FD were found to be lower than Spl[ADP] for ε = 0.693. Moreover, the use of RAPPOR enhanced the solution’s performance for ε = 1.09.
Overall, it can be said that RAPPOR performed better than benchmark solution Smp[ADP] but not Spl[ADP]. HR did not perform as well as RAPPOR in all of the test cases. Lastly, the addition of RAPPOR to RS + FD which was called Sarve was found to perform on par and better for certain values of ε.
For general privacy regime
For the datasets that had a large number of observations, that is the UCI Adult and MS-FIMU datasets, HR was found to perform better than Smp[ADP] for ε < 5. The performance of the method degraded as we moved to lower privacy regimes. The MSE achieved by RAPPOR was consistently better than HR and lower than those of RS + FD and Sarve for low privacy regimes. For the UCI Nursery dataset characterized by a smaller number of observations and high dimensionality of nine, HR did not perform well but RAPPOR gave low MSE for low privacy regimes. Overall, the privatization performance of Sarve was comparable to RS + FD[Adp] and better for specific values of ε.
The graphs were plotted for the MSE averaged over a hundred runs. For a clearer benchmarking between existing solution and the proposed work, the lowest MSE reported by the methods have been summarized in Tables 3, 4, and 5.
Results on synthetic datasets
The properties of the synthetic datasets used for benchmarking are summarized in Table 2. The algorithms were tested for uniform as well as non-uniform distributions for a large number of observations and different dimensions. The MSE averaged over a hundred runs for synthetic datasets post-privatization by Spl[ADP], Smp[ADP], RS + FD[ADP], RAPPOR, Hadamard Response, and Sarve have been shown in Figs. 8, 9, 10, 11, 12, and 13 respectively.
The effects of different factors like the number of observations attribute counts and domain values had affected the performance of randomization algorithms.
For high privacy regime
The numbers of observations were 50 K and 500 K with dimensionalities that took the values five and ten for uniform distribution, ten and twenty for non-uniform distribution. It was observed that the increase in the number of observations from 50 to 500 K had an adverse effect on the performance of Hadamard Response but RAPPOR remained immune to it. The performance of RAPPOR solely used as a randomization mechanism performed better than Smp[ADP] for all of the test cases. Interestingly, for a non-uniform distribution dataset having 50 K observations and ten attributes, HR performed better than RAPPOR. In all of the test configurations, Sarve performed on par with RS + FD[ADP].
For general privacy regime
The performance of RAPPOR as the sole randomization mechanism in the case of datasets with ten attributes was found better than Smp[ADP]. The recorded MSE showed a stable trend. The change in the number of attributes affected the performance of HR more than RAPPOR. Lastly, Sarve performed on par with RS + FD[ADP] with the former giving lower MSE for specific values of ε (Tables 6, 7).
The graphs were plotted for the MSE averaged over a hundred runs. For a clearer benchmarking between the existing solution and the proposed work, the lowest MSE reported by the methods has been summarized in Tables 3, 4 and 5.
Conclusion
In this paper, the authors propose a novel frequency oracle termed Sarve for privacy-aware frequency estimation of categorical attributes of multi-user records. The privatization provided by Sarve utilized RAPPOR for randomization in addition to fake data. Existing research by Arcolezi et al. had used an adaptive combination of General Randomized Response and Optimal Unary Coding with fake data to prove that such mechanisms are well-suited for frequency oracles.
The use of a transformation-based method like Hadamard Response was found to perform on par with the existing work. The benefits offered by Hadamard Response include lower communication costs and therefore it emerged as a worthy alternative. Additionally, the implementation of Sarve tested the application of a hash-based method like RAPPOR. It was found that RAPPOR performed better than GRR and OUE for specific privacy conditions. Therefore, an adaptive privatization algorithm was devised to employ GRR, OUE, or RAPPOR based on the variance values. The proposed algorithms were tested on real-world as well as synthetic datasets that varied over the number of observations, dimensionalities, and size of allowed domain values. The adaptive performance of Sarve was found to be on par with the solution by Arcolezi et al. and performed better for specific privacy scenarios.
There is vast potential in the development of frequency oracles since all of the cloud-hosted services and platforms collect user information. The RAPPOR method is already in use by Google's Chrome browser and many popular tools. Therefore, the ability to amplify the privacy offered by such techniques in combination with fake data is an exciting avenue. This research can be extended to reduce the uncertainty introduced through the incorporation of fake data. Additionally, several other encoding schemes such as OLE exist that can be enhanced to produce frequency oracles like Sarve.
Availability of data and materials
The datasets used for the experiments are freely available to researchers. The links to the data have been cited as references.
References
Ahamad D, Alam Hameed S, Akhtar M (2020) A multi-objective privacy preservation model for cloud security using hybrid Jaya-based shark smell optimization. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/J.JKSUCI.2020.10.015
Arcolezi HH, Couchot JF, Al Bouna B, Xiao X (2021a) Random sampling plus fake data: multidimensional frequency estimates with local differential privacy. Int Conf Inf Knowl Manag Proc. https://doi.org/10.1145/3459637.3482467
Balle B, Barthe G, Gaboardi M (2018) Privacy amplification by subsampling: tight analyses via couplings and divergences. Adv Neural Inf Process Syst 2018:6277–6287
Ben Basat R, Chen X, Einziger G, Rottenstreich O (2020) Designing heavy-hitter detection algorithms for programmable switches. IEEE/ACM Trans Netw 28(3):1172–1185. https://doi.org/10.1109/TNET.2020.2982739
Boulanger M (2018) Scraping the bottom of the barrel: Why it is no surprise that data scrapers can have access to public profiles on linkedIn. Sci Technol Law Rev 21(1):77
Campbell M (2019) Synthetic data: how AI is transitioning from data consumer to data producer and why that’s important. Computer 52:89–91. https://doi.org/10.1109/MC.2019.2930097
Cheu A, Smith A, Ullman J, Zeber D, Zhilyaev M (2019a) Distributed differential privacy via shuffling. Lect Notes Comput Sci. https://doi.org/10.1007/978-3-030-17653-2_13
Djenouri Y, Belhadi A, Fournier-Viger P (2018) Extracting useful knowledge from event logs: a frequent itemset mining approach. Knowl Based Syst 139:132–148. https://doi.org/10.1016/J.KNOSYS.2017.10.016
Djenouri Y, Djenouri D, Belhadi A, Cano A (2019) Exploiting GPU and cluster parallelism in single scan frequent itemset mining. Inf Sci (NY) 496:363–377. https://doi.org/10.1016/J.INS.2018.07.020
Emam KE, Mosquera L, Zheng C (2021) Optimizing the synthesis of clinical trial data using sequential trees. J Am Med Inform Assoc 28(1):3–13
Erlingsson Ú, Pihur V, Korolova A (2014) RAPPOR: randomized aggregatable privacy-preserving ordinal response. Proc ACM Conf Comput Commun Secur. https://doi.org/10.1145/2660267.2660348
Hittmeir M, Ekelhart A, Mayer R (2019) Utility and privacy assessments of synthetic data for regression tasks. Proc IEEE Int Conf Big Data 2019:5763–5772. https://doi.org/10.1109/BIGDATA47090.2019.9005476
Hoffmann J, Bar-Sinai Y, Lee LM, Andrejevic J, Mishra S, Rubinstein SM, Rycroft CH (2019) Machine learning in a data-limited regime: augmenting experiments with synthetic data uncovers order in crumpled sheets. Sci Adv. https://doi.org/10.1126/SCIADV.AAU6792/SUPPL_FILE/AAU6792_SM.PDF
Joseph M, Roth A, Ullman J, Waggoner B (2018) Local differential privacy for evolving data. J Priv Confid 10:1–29
Kacha L, Zitouni A, Djoudi M (2021) KAB: a new k-anonymity approach based on black hole algorithm. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/J.JKSUCI.2021.04.014
Kairouz P, Oh S, Viswanath P (2016b) Extremal mechanisms for local differential privacy. J Mach Learn Res 17(1):492–542
Kirsch MS (2011) Do-not-track: revising the EUâ??s data protection framework to require meaningful consent for behavioral advertising. Richmond J Law Technol 18:1
Lee J, Clifton C (2011) How much is enough? Choosing ε for differential privacy. Lect Notes Comput Sci 7001:325–340. https://doi.org/10.1007/978-3-642-24861-0_22
Li S, Mu N, Le J, Liao X (2019) Privacy preserving frequent itemset mining: maximizing data utility based on database reconstruction. Comput Secur 84:17–34. https://doi.org/10.1016/J.COSE.2019.03.008
Luna JM, Fournier-Viger P, Ventura S (2019) Frequent itemset mining: a 25 years review. Wiley Interdiscip Rev Data Min Knowl Discov 9(6):e1329. https://doi.org/10.1002/WIDM.1329
Mahanti R (2021) Data governance and compliance. Data Gov Compliance. https://doi.org/10.1007/978-981-33-6877-4_5
Mehta BB, Rao UP (2019) Improved l-diversity: scalable anonymization approach for privacy preserving big data publishing. J King Saud Univ - Comput Inf Sci. https://doi.org/10.1016/J.JKSUCI.2019.08.006
Memon I, Shaikh RA, Fazal H, Hanif Tunio M, Arain QA (2020) The world of hacking: a survey. Univ Sindh J Inf Commun Technol 4(1):31–37
Pekar A, Duque-Torres A, Seah WKG, Caicedo O (2021) Knowledge discovery: can it shed new light on threshold definition for heavy-hitter detection? J Netw Syst Manag 29(3):1–30. https://doi.org/10.1007/S10922-021-09593-W
Quick H (2021) Generating Poisson-distributed differentially private synthetic data. J R Stat Soc Ser A 184:1093–1108. https://doi.org/10.1111/RSSA.12711
Rouane O, Belhadef H, Bouakkaz M (2019) Combine clustering and frequent itemsets mining to enhance biomedical text summarization. Expert Syst Appl 135:362–373. https://doi.org/10.1016/J.ESWA.2019.06.002
Snoke J, Raab GM, Nowok B, Dibben C, Slavkovic A (2018) General and specific utility measures for synthetic data. J Res Stat Soc Ser A 181:663–688. https://doi.org/10.1111/RSSA.12358
Sordello M, Bu Z, Dong J (2021) Privacy amplification via iteration for shuffled and online PNSGD. Lect Notes Comput Sci 12976:796–813. https://doi.org/10.1007/978-3-030-86520-7_49
Tanwar G, Chauhan R, Singh M, Singh D (2020a) Pre-emption of affliction severity using HRV measurements from a smart wearable; case-study on SARS-Cov-2 symptoms. Sensors 20(24):7068. https://doi.org/10.3390/s20247068
Tanwar G, Chauhan R, Singh D (2020b) User privacy in smart systems: recent findings and countermeasures. SSRN Electron J. https://doi.org/10.2139/ssrn.3565901
Tanwar G, Chauhan R, Yafi E (2021) ARTYCUL: a privacy-preserving ML-driven framework to determine the popularity of a cultural exhibit on display. Sensors 21(4):1527. https://doi.org/10.3390/s21041527
Tu Z, Zhao K, Xu F, Li Y, Su L, Jin D (2018) Protecting trajectory from semantic attack considering ${k} $-anonymity, ${l} $-diversity, and ${t} $-closeness. IEEE Trans Netw Serv Manage 16(1):264–278
Wang Z, Ma P, Wang R, Zhang J, Chi Y, Ma Y, Yang T (2018a) Secure medical data collection via local differential privacy. IEEE Int Conf Comput Commun ICCC 2018:2446–2450. https://doi.org/10.1109/COMPCOMM.2018.8780925
Wang T, Zhao J, Hu Z, Yang X, Ren X, Lam KY (2021a) Local differential privacy for data collection and analysis. Neurocomputing 426:114–133. https://doi.org/10.1016/J.NEUCOM.2020.09.073
Wang T, Li N, Jha S (2021b) Locally differentially private heavy hitter identification. IEEE Trans Dependable Secur Comput 18(2):982–993. https://doi.org/10.1109/TDSC.2019.2927695
Warner SL (1965) Randomized response: a survey technique for eliminating evasive answer bias. J Am Stat Assoc 60:63–69. https://doi.org/10.1080/01621459.1965.10480775
Xiong X, Liu S, Li D, Cai Z, Niu X (2020) A comprehensive survey on local differential privacy. Secur Commun Netw. https://doi.org/10.1155/2020/8829523
Xue Q, Zhu Y (2022) Mean estimation over numeric data with personalized local differential privacy. Front Comput Sci 163(16):1–10. https://doi.org/10.1007/S11704-020-0103-0
Xue Q, Zhu Y, Wang J (2021) Joint distribution estimation and naïve bayes classification under local differential privacy. IEEE Trans Emerg Top Comput 9(4):2053–2063. https://doi.org/10.1109/TETC.2019.2959581
Ye Y, Zhang M, Feng D, Li H, Chi J (2019) Multiple privacy regimes mechanism for local differential privacy. Lect Notes Comput Sci 11447:247–263. https://doi.org/10.1007/978-3-030-18579-4_15
Zhao D, Chen H, Zhao S, Zhang X, Li C, Liu R (2019) Local differential privacy with k-anonymous for frequency estimation. Proc IEEE Int Conf Big Data 2019:5819–5828. https://doi.org/10.1109/BIGDATA47090.2019.9006022
Zhao D, Zhao S, Chen H, Liu R, Li C, Liang W (2022) Efficient protocols for heavy hitter identification with local differential privacy. Front Comput Sci 16(5):1–11. https://doi.org/10.1007/S11704-021-0412-Y
Zheng H, Hu H, Han Z (2020) Preserving user privacy for machine learning: local differential privacy or federated machine learning? IEEE Intell Syst 35:5–14. https://doi.org/10.1109/MIS.2020.3010335
Zheng X, Yan K, Duan J, Tang W, Tian L (2021) Histogram publication over numerical values under local differential privacy. Wirel Commun Mobile Comput. https://doi.org/10.1155/2021/8886255
Abay NC, Zhou Y, Kantarcioglu M, Thuraisingham B, Sweeney L (2018) Privacy preserving synthetic data release using deep learning. In: Joint European conference on machine learning and knowledge discovery in databases, Springer, Cham, pp 510–526
Acharya J, Sun Z, Zhang H (2018) Hadamard response: estimating distributions privately, efficiently, and with little communication. In: AISTATS 2019—22nd international conference on artificial intelligence and statistics
Acharya J, Canonne C L, Freitag C, Tyagi H (2019) Test without trust: optimal locally private distribution testing
Alkhalifah T, Wang H, Ovcharenko O (2021) MLReal: bridging the gap between training on synthetic data and real data applications in machine learning, pp 1–5. https://doi.org/10.3997/2214-4609.202113262/CITE/REFWORKS
Arcolezi HH, Couchot JF, Baala O, Contet JM, Al Bouna B, Xiao X, Al B (2021b) Mobility modeling through mobile data: generating an optimized and open dataset respecting privacy
Bautista P, Inventado PS (2021) Protecting student privacy with synthetic data from generative adversarial networks, pp 66–70. https://doi.org/10.1007/978-3-030-78270-2_11
Cao X, Jia J, Gong N Z (2019) Data poisoning attacks to local differential privacy protocols. In: Proceedings of 30th USENIX security symposium, pp 947–964
Chen W N, Kairouz P, Özgür A (2020) Breaking the communication-privacy-accuracy trilemma. arXiv preprint arXiv:2007.11707.
Cheu A, Smith A, Ullman J (2019b) Manipulation attacks in local differential privacy. In: Proceedings of IEEE symposium on security and privacy, 2021-May, pp 883–900. https://doi.org/10.1109/SP40001.2021.00001
Cormode G, Kulkarni T, Srivastava D (2018) Marginal release under local differential privacy. In: Proceedings of 2018 international conference on management of data, vol 16. https://doi.org/10.1145/3183713
Cormode G, Maddock S, Maple C (2021) Frequency estimation under local differential privacy [experiments, analysis and benchmarks]. In: Proceedings of VLDB Endow, vol 14, pp 2046–2058. https://doi.org/10.14778/3476249.3476261
Dong J, Roth A, Su WJ (2019) Gaussian differential privacy. arXiv preprint arXiv:1905.02383
Dwork C, Rothblum GN, Vadhan S (2010a) Boosting and differential privacy. In: 2010a IEEE 51st annual symposium on foundations of computer science, IEEE, pp 51–60
Dwork C, Naor M, Pitassi T, Rothblum G N (2010b) Differential privacy under continual observation. In: Proceedings of the forty-second ACM symposium on theory of computing, pp 715–724
Erlingsson Ú, Feldman V, Mironov I, Raghunathan A, Talwar K, Thakurta A (2019) Amplification by shuffling: from local to central differential privacy via anonymity. In: Proceedings, pp 2468–2479. https://doi.org/10.1137/1.9781611975482.151
Feldman V, Mironov I, Talwar K, Thakurta A (2018) Privacy amplification by iteration. In: Proceedings of annual IEEE symposium foundations of computer science. FOCS 2018-Octob, pp 521–532. https://doi.org/10.1109/FOCS.2018.00056
Feldman V, Audra A, Apple M, Apple KT (2020) Hiding among the clones: a simple and nearly optimal analysis of privacy amplification by shuffling
Gatha, Chauhan R, Singh D (2020a) Ensuring privacy-aware data release: an analysis of applicability of privacy enhancing techniques to real-world datasets. In: ICRITO 2020a—IEEE 8th international conference on reliability, infocom technologies and optimization (trends and future directions). https://doi.org/10.1109/ICRITO48877.2020a
Gatha, Chauhan R, Singh D (2020b) Ensuring privacy-aware data release: an analysis of applicability of privacy enhancing techniques to real-world datasets. https://doi.org/10.1109/ICRITO48877.2020b
Ghalebikesabi S, Wilde H, Jewson J, Doucet A, Vollmer S, Holmes C (2021) Bias mitigated learning from differentially private synthetic data: a cautionary tale. arXiv preprint arXiv:2108.10934
Grafenstein M, Heumüller J, Belgacem E, Jakobi T, Smiesko P (2021) Effective regulation through design—aligning the eprivacy regulation with the EU general data protection regulation (GDPR): tracking technologies in personalised internet content and the data protection by design approach. SSRN Electron J. https://doi.org/10.2139/SSRN.3945471
Härting M, Partgmbb R, Niko H (2017) Study on the impact of the proposed ePrivacy regulation centre for information policy leadership 30 St Mary Axe London, EC3A 8EP
Hittmeir M, Mayer R, Ekelhart A (2020) A baseline for attribute disclosure risk in synthetic data. In: CODASPY 2020—proceedings of the tenth ACM conference on data and application security and privacy, pp 133–143. https://doi.org/10.1145/3374664.3375722
Huang SY, Ban T (2020) Monitoring social media for vulnerability-threat prediction and topic analysis. In: Proceedings of 2020 IEEE 19th international conference on trust, security and privacy in computing and communications 2020, pp 1771–1776. https://doi.org/10.1109/TRUSTCOM50675.2020.00243
Jia J, Gong NZ (2019) Calibrate: frequency estimation and heavy hitter identification with local differential privacy via incorporating prior knowledge. In: Proceedings of IEEE INFOCOM 2019-April: 2008–2016. https://doi.org/10.1109/INFOCOM.2019.8737527
Kairouz P, Bonawitz K, Ramage D (2016a) Discrete distribution estimation under local privacy
Kenthapadi K, Mironov I, Thakurta AG (2019) Privacy-preserving data mining in industry. In: WSDM 2019—Proceedings of 12th ACM international conference on web search data mining, pp 840–841. https://doi.org/10.1145/3289600.3291384
Kifer D, Messing S, Roth A, Thakurta A, Zhang D (2020) Guidelines for implementing and auditing differentially private systems
Kohavi R (1996) Scaling up the accuracy of naive-bayes classifiers: a decision-tree hybrid. In: Kdd, vol 96, pp 202–207
Le BD, Zia T (2021) Discrete distribution estimation with local differential privacy: a comparative analysis. In: 2021 IEEE International conference on pervasive computing and communications, PerCom Work, pp 692–697. https://doi.org/10.1109/PerComWorkshops51409.2021.9431028
Li N, Qardaji W, Su D (2012) On sampling, anonymization, and differential privacy or, k-anonymization meets differential privacy. In: ASIACCS 2012—7th ACM symposium information computer and communications security, pp 32–33. https://doi.org/10.1145/2414456.2414474
Li M, Tian Y, Zhang J, Fan D, Zhao D (2021) The trade-off between privacy and utility in local differential privacy. In: 2021 International conference on network application, pp 373–378. https://doi.org/10.1109/NANA53684.2021.00071
Lin BC, Wu S , Tsou YT, Huang Y (2018) PPDCA: privacy-preserving crowdsensing data collection and analysis with randomized response. In: IEEE wireless communications and networking conference WCNC 2018-April, pp 1–6. https://doi.org/10.1109/WCNC.2018.8377050
Liu H, Bai X, Ma X, Cui L (2020) Frequent itemset mining with hadamard response under local differential privacy. In: ICEIEC 2020—proceedings of 2020 IEEE 10th International conference on electronic information, emerging communication, pp 49–52https://doi.org/10.1109/ICEIEC49280.2020.9152248
Lopuhaä-Zwakenberg M, Škorić B, Li N (2019) Information-theoretic metrics for local differential privacy protocols
Lopuhaä-Zwakenberg M, Li Z, Skoric B, Li N (2020) Improving frequency estimation under local differential privacy. In: WPES 2020—Proceedings of 19th workshop on privacy in the electronic society, pp 123–135. https://doi.org/10.1145/3411497.3420215
Naor M, Pinkas B, Ronen E (2019) How to (not) share a password: Privacy preserving protocols for finding heavy hitters with adversarial behavior. In: Proceedings of the 2019 ACM SIGSAC conference on computer and communications security, pp 1369–1386
Nguyên TT, Xiao X, Yang Y, Hui SC, Shin H, Shin J (2016) Collecting and analyzing data from smart device users with local differential privacy. arXiv preprint arXiv:1606.05053.
Olave M, Rajkovic V (1989) Administration, M.B.-E.S. In: An application for admission in public school systems. kt.ijs.si
Rahimian S, Orekondy T, Fritz M (2020) Sampling attacks: amplification of membership inference attacks by repeated queries
Regulation with the EU General Data Protection Regulation (GDPR) Tracking technologies in personalised internet content and the data protection by design approach. SSRN Electron J. https://doi.org/10.2139/SSRN.3945471
Rosenblatt L, Liu X, Pouyanfar S, de Leon E, Desai A, Allen J (2020) A differentially private synthetic data: applied evaluations and enhancements. development, M.A., Program
Snoke J, Slavković A (2018) pMSE mechanism: differentially private synthetic data with maximal distributional similarity. Lect Notes Comput Sci 11126 LNCS:138–159. https://doi.org/10.1007/978-3-319-99771-1_10
Stadler T, Oprisanu B, Troncoso C (2022) Synthetic data—anonymisation groundhog day
Vietri G, Tian G, Bun M, Steinke T, Wu Z S (2020) New Oracle-efficient algorithms for private synthetic data release
Wagenseil P (2020) Zoom security issues: here's everything that's gone wrong (so far). Toms guide, pp 1–3
Wang S, Huang L, Wang P, Nie Y, Xu H, Yang W, Li XY, Qiao C (2016) Mutual information optimally local private discrete distribution estimation
Wang T, Blocki J, Li N, Jha S (2017) Locally differentially private protocols for frequency estimation. In: 26th {USENIX} security symposium ({USENIX} security 17), pp 729–745
Wang T, Li N, Jha S (2018b) Locally differentially private frequent itemset mining. In: Proceedings of IEEE symposium on security and Privacy 2018b-May, pp 127–143. https://doi.org/10.1109/SP.2018b
Wang N, Xiao X, Yang Y, Zhao J, Hui S C, Shin H, Shin J, Yu G (2019a) Collecting and analyzing multidimensional data with local differential privacy. In: Proceedings—international conference on data engineering, pp 638–649. https://doi.org/10.1109/ICDE.2019a
Wang T, Ding B, Zhou J, Hong C, Huang Z, Li N, Jha S (2019b) Answering multi-dimensional analytical queries under local differential privacy. In: Proceedings of ACM SIGMOD international conference on management of data, pp 159–176. https://doi.org/10.1145/3299869.3319891
Wang T, Ding B, Zhou J, Hong C, Huang Z, Li N, Jha S (2019c) Answering multi-dimensional analytical queries under local differential privacy. In: Proceedings of 2019c international conference on management of data, vol 18. https://doi.org/10.1145/3299869
Xu M, Ding B, Wang T, Zhou J (2020) Collecting and analyzing data jointly from multiple services under local differential privacy. Proc VLDB Endow 13:2760–2772. https://doi.org/10.14778/3407790.3407859
Yang M, Lyu L, Zhao J, Zhu T, Lam KY (2020) Local differential privacy and its applications: a comprehensive survey
Yang M, Tjuawinata I, Lam K-Y, Zhu T, Zhao J (2021) Fair and differentially private distributed frequency estimation. https://doi.org/10.48550/arxiv.2104.05974
Zhang Z, Wang T, Li N, He S, Chen J (2018) CALM: consistent adaptive local marginal for marginal release under local differential privacy. In: Proceedings of 2018 ACM SIGSAC conference on computer and communications security, vol 18. https://doi.org/10.1145/3243734
Zhu W, Kairouz P, McMahan B, Sun H, Li W (2020) Federated heavy hitters discovery with differential privacy. In: International conference on artificial intelligence and statistics, PMLR, pp 3837–3847
Acknowledgements
The authors would like to acknowledge the constructive feedback by the anonymous reviewers. Their comments were instrumental in elevating the quality of this research paper.
Funding
This research did not receive any funding.
Author information
Authors and Affiliations
Contributions
GV and RC; validation, RC; formal analysis, GV and RC; investigation, GV; resources, GV; data curation, GV and RC; writing—original draft preparation, GV and RC; writing—review and editing, GV, RC; visualization, GV; supervision, RC; project administration, RC; funding acquisition, not applicable. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they do not have any known competing financial interests, or any personal relationships that appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Varma, G., Chauhan, R. & Singh, D. Sarve: synthetic data and local differential privacy for private frequency estimation. Cybersecurity 5, 26 (2022). https://doi.org/10.1186/s42400-022-00129-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s42400-022-00129-6